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(54) IMAGE PROCESSOR 

(57)Abstract: 

PROBLEM TO BE SOLVED: To output an image that has a stereoscopic effect 
and a depth feeling with a simple operation by automatically making a main part 
sharp and giving background an out-of-focus effect (foreground out-of-focus 
effect) that shades off the background. 

SOLUTION: A photoprinter 10 consists of a scanner 12an image processor 
(processor) 14 and a printer 16. The processor 14 has a detecting part 18 and an 
image processing part 20performs image processing of image data that is read by 
the scanner 12etc.in accordance with prescribed image processing and the 
instruction of an operator and makes it image data for image recording by the 
printer 16. When image information of two same images that have different focus 
conditions is received and when the main part and background of the image are 
detectedimage processing that makes the main part and background different is 
performed to at least one of image information of the two images in accordance 
with the detection result. Not only normal image processing but alsowhat is calleda 
background out-of-focus (foreground out-of- focus) effect are given to an image 
to be formedthat isthe main part is accurately brought into a focus and the 
background is suitably shaded off. 



CLAIMS 



[Claim(s)] 

[Claim 1]An image processing device comprising: 

A detection means to detect the principal part and a background of said picture in 
response to picture information of the picture of two sheets from which focal 
conditions differ. 

An image processing means which performs image processing which is different for 
the principal part and a background in at least one side of picture information of 



said picture of two sheets according to said detection result. 



[Claim 2]The image processing device according to claim 1 whose image 
processing which image processing performed to said principal part performs to 
said background by sharp-ized processing in said image processing means is 
BOKASHI processing. 

[Claim 3]The image processing device according to claim 1 or 2 with which one 
side is the picture to which said picture of two sheets doubled a focus with the 
principal partand is the picture to which another side doubled a focus with a 
backgroundand said detection means detects the principal part and a background 
of said picture using an edge component of a picture of two sheets. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention belongs to the technical field of the image 
processing device used for digital image reading playback equipment etc. and 
relates to the image processing device which makes it possible to output a picture 
with a cubic effect or a feeling of depth by simple operation in detail. 
[0002] 

[Description of the Prior Art]Nowbaking to photosensitive materialssuch as 
photographic paper etc. of the picture photoed by photographic films (it is 
hereafter considered as a film)such as a negative film and a reversal filmhas 
exposure what is called directly [ that the projected light of a film is entered into 
photosensitive materialsand carries out field exposure of the photosensitive 
materials by this projected light ] (analog) in use. 

[0003]on the other handthe printing equipment which uses digital exposure in 
recent years — that isAfter reading in photoelectricity the picture photoed by the 
film and making the read picture into a digital signalVarious image processing was 
performedit was considered as the image data for recordand the digital photo 
printer which carries out scanning exposure of the photosensitive materialsrecords 
a picture (latent image)performs a developmentand is outputted as a print 
(photograph) by the recording light modulated according to this image data was put 
in practical use. 

[0004]In a digital photo printera film is read in photoelectricityby signal 
processingdepth-of-shade amendment is performed and an exposing condition is 
determined. Thereforeadjustment of the determination of the exposing condition 
by the operator at the time of exposurea filteretc. is unnecessaryand according to 
image sizesince it is fixedexposure time can also do efficient work. According to 
the digital photo printeras compared with the print by the conventional direct 
exposure in respect of resolutiona color/density reproducibilityetc.An output is 
possible for the print which reproduced the high definition picturemoreoverimage 



processingsuch as image editingssuch as picture composition and divisiona 
color/concentration adjustmentedge enhancementcan also be performed freelyand 
the print freely processed according to the use can be outputted. Since the 
picture of a print is fundamentally treated as image datait can supply not only the 
output of a print but image data to a computer etc. or can also save it as image 
data at storagessuch as a floppy disk. The picture (image data) photoed with a 
digital camera (electronic "still" camera)a digital camcorderetc. and the picture 
memorized by said recording medium can also be outputted as a print. 
[0005]Such a digital photo printer comprises a scanner (image reader)an image 
processing deviceand an image recorder (printer) fundamentally. A scanner by 
obtaining the projected light which supports the picture photoed by entering into a 
film in read lightcarrying out image formation of this projected light to image 
sensorssuch as a CCD sensorand carrying out photoelectric conversionThe 
picture photoed by the film is read and it sends to an image processing device as 
image data (image data signal) of a film. An image processing device receives the 
image data sent from the scannerperforms predetermined image processingand 
sends it to a printer as image data (exposing condition) for record. If a printer is a 
device which receives the image data outputted from the image processing 
devicefor exampleuses optical beam scanning exposureit will modulate an optical 
beam according to the image data sent from the image processing deviceand will 
deflect it to a scanning directionand. By conveying photosensitive materials 
(photographic paper) to the vertical scanning direction which intersects 
perpendicularly with a scanning directionscanning exposure (printed) of the 
photosensitive materials is carried out by an optical beama latent image is 
formedthe development according to photosensitive materialsetc. are 
performedand it outputs as a print in which the picture photoed by the film was 
reproduced. 
[0006] 

[Problem(s) to be Solved by the InventionjBy the waywhat is called a back 
Japanese quince (or front Japanese quince) effect that doubled the focus (focus) 
with the principal part (major object) exactly as processing for reproducing the 
high-definition picture which reproduced a cubic effect and a feeling of depth 
suitablyand carried out Boca of the background suitably is known. In order to 
acquire the picture which gave the back Japanese quince effect in the photograph 
printer of the conventional direct exposureThe camera with indispensable using an 
expensive single-lens reflex camera etc. for photographya cheap disposable 
camerasuch as being a compact camera and copy Lung (made by Fuji Photo Film 
Co.Ltd.)etc. Since it is in the tendency which can perform only pan-focus 
photography whose focus suits to the whole screenit is impossible to acquire the 
picture which gave the back Japanese quince effect. On the other handif it is the 
above-mentioned digital photo printerit is possible to form the picture which gave 
the back Japanese quince effect by image processing from the picture photoed 
with the compact camera etc. 

[0007]The picture which gave the back Japanese quince effect by image 



processinglmage-processing toolssuch as photo retouch software of marketing like 
a Photoshop (made by Adobe)are usedAfter clipping the principal part from a 
pictureperforming sharp-ized (sharpness) processing to the principal part and 
performing BOKASHI processing to another side and a backgroundit can form by 
compounding the principal part and a background. That isin order for image 
processing to give the back Japanese quince effect to a pictureclipping processing 
is requiredbut since it is almost impossible to carry out automatically [ clipping 
processing is complicated and ]an operator needs to perform clipping work using a 
user interface etc. And as mentioned abovesince clipping work is complicatedit 
turns into work which requires time and effort and time dramatically depending on 
a pictureand becomes a heavy burden for an operator in many cases. 
[0008]Even from the picture which the purpose of this invention has in solving the 
problem of said conventional technologyand was photoed with cheap 
camerasdigital camerasetc.such as a compact camera and a disposable camera. 
Without doing the complicated work of the clipping work by the operator using an 
image-processing tool etc.etc.automaticallythe principal part is sharp and there is 
in providing the image processing device which makes it possible to form the 
picture which gave the back Japanese quince effect (the front Japanese quince 
effect) which carried out Boca of the background. 
[0009] 

[Means for Solving the Problem]An image processing device this invention is 
characterized by that comprises the following in order to attain said purpose. 
A detection means to detect the principal part and a background of said picture in 
response to picture information of the picture of two sheets from which focal 
conditions differ. 

An image processing means which performs image processing which is different for 
the principal part and a background in at least one side of picture information of 
said picture of two sheets according to said detection result. 

[0010]In said image processing meansit is preferred that image processing which 
image processing performed to said principal part performs to said background by 
sharp-ized processing is BOKASHI processing. 

[001 1]It is the picture to which said picture of two sheets doubled a focus with 
the principal partand one side is the picture to which another side doubled a focus 
with a backgroundand it is preferred that said detection means detects the 
principal part and a background of said picture using an edge component of a 
picture of two sheets. 
[0012] 

[Embodiment of the Invention] Hereafterthe preferred embodiment shown in an 
attached drawing is described to origin in detail about the image processing device 
of this invention. 

[0013]The block diagram of an example using the image processing device of this 
invention of a digital photo printer is shown in drawing 1 . The digital photo printer 
10 (it is hereafter considered as the photograph printer 10) creates the print which 



reproduced the picture photoed by filmssuch as SUTORIPPUSU by which many 
pictures are photoed by the long picture filmand a slide which holds a reversal film 
to a frame. The scanner 12 which is a reader with which such a photograph printer 
10 reads in photoelectricity the picture photoed by the filmPredetermined image 
processing is performed to the image data etc. of the film read with the scanner 
12The image processing device 14 (it is hereafter considered as the processing 
unit 14) of this invention outputted as image data for an outputScanning exposure 
of the photosensitive materials is carried out by the optical beam modulated 
according to the image data outputted from the processing unit Hand it has the 
printer 16 which is a recorder which performs a development and is outputted as a 
printand is constituted. 

[0014]The scanner 12 which reads in photoelectricity the picture photoed by the 
filmA light sourcea variable aperturethe colored filter board that decomposes into 
the three primary colors of R (red)G (green)and B (blue) the picture photoed by 
the filmlt is a reader of a publicly known picture which has LUT (look-up table) etc. 
which carry out log conversion of image sensorssuch as an image formation lens 
unit and a CCD sensoran A/D (analog to digital) converterand the signal. 
[0015]When it is ejected from a light sourceand light volume adjustment is carried 
out by the variable aperture and the read light by which color adjustment was 
carried out by passing enters and penetrates a colored filter board on a film by it 
in the scanner 12the projected light which supports the picture photoed by the 
film is obtained. Image formation of the projected light of a film is carried out to 
the acceptance surface of a CCD sensor by the image formation lens unitand it is 
read in photoelectricity. It is digital-signal-ized by an A/D converterlog conversion 
is carried out by LUTand the output signal from a CCD sensor is sent to the 
processing unit 14 as image data (digital) of the picture photoed by the film. In the 
scanner 12by inserting the colored filter of RGand B one by oneand performing 
such image reading 3 timesit decomposes into the three primary colors of RGand 
Band the picture photoed by the film is read. 

[0016]The processing unit 14 has the primary detecting element 18 and the image 
processing portion 20and predetermined image processing and image processing 
according to directions of the operator are performed to the image data read in 
the scanner 12 gradelt is considered as the image data for image recording based 
on the printer 16and is constituted combining CPUa memoryvarious kinds of image 
processing circuitsetc. The processing unit 14 is what performs control and 
management of the photograph printer 10 whole in addition to image 
processingBesides an image-processing-related partmotion control and various 
kinds of directions of the photograph printer 10 wholeCPU which managesthe 
memory which memorizes data required to operate the photograph printer 10 
wholeA means to determine the diaphragm value of the variable aperture in this 
scan etc. are arrangedDirections (setting out) of various conditions and 
processingsthe top and print number of sheets to printThe display 40 which 
displays setting out/registration pictures which were read with the keyboard 36 for 
inputting directions of a color/density correctionetc. and the mouse 38and the 



scanner 12such as various conditionssuch as a picturevarious kinds of operator 
guidanceand a pattern of a school photographand specificationis connected. 
Thereforesuch a processing unit 14 is usually constituted by a 
workstationcomputeretc. 

[0017]The image data which the processing unit 14 concerning this invention 
processesOnly not only in the image data supplied from the scanner 12 which 
reads the film image illustratedThe image data of the picture photoed with a digital 
camera (electronic "still" camera)a digital camcorderetc.lt may be the image data 
etc. which were read with the reader of reflection copiessuch as printed matterand 
may be the image data memorized by storagessuch as a floppy disk and MO 
(optical magnetic storage medium). 

[0018]When creating the print by the usual image processing (output of processed 
image data)the image data supplied from the scanner 12 grade is sent to the image 
processing portion 20. Compression/extension of the dynamic range of the picture 
which held a color/density correctionand an intermediate floor tone to the image 
data to which the image processing portion 20 was supplied (grant of the color 
dodge effect by image processing)Predetermined image processingsuch as variable 
power processing of the picture by image data processingi.e. electronic variable 
power processingand sharp-ized (sharpness) processing of a pictureis 
performedand it outputs to the printer 16 as image data for record. In the 
processing unit 14amendment of various kindssuch as amendment and a shading 
compensationmay be performed to the image data supplied from the scanner 12 
grade if needed if needed at the time of DC offset amendment and dark before 
said image processing (or grant of the back Japanese quince effect mentioned 
later). 

[0019]Herethe processing unit 14 concerning this invention can perform not only 
usual image processing such but grant of what is called a back Japanese quince 
(front Japanese quince) effect that doubled the focus with the principal part 
exactly and carried out Boca of the background to the picture to form suitably. 
Hereafterthe composition of the image processing device of this invention is 
explained more to details with the operation at the time of giving the back 
Japanese quince effect. 

[0020]When giving the back Japanese quince effectto the processing unit 14. It is 
the image data of two pictures from which focal conditions differ by the pictureand 
the picture (scene) same concrete completelyand two image datathe image data of 
the picture whose focus suits to the principal part (major objecOand the image 
data of the picture whose focus suits to the backgroundis supplied. In the 
processing unit 14both~images data is sent to the primary detecting element 
18and only the image data of the picture whose focus suits to the principal part is 
sent to the image processing portion 20. such a picture — a tripod etc. — a 
camera (an optical camera and a digital camera.) A photograph is taken by fixing a 
digital camcorder etc. and doubling a focus with the principal part at 
firstSubsequentlythe method of taking a photograph by doubling a focus with a 
background and the camera which has a look sensor of a focal position are 



usedAfter taking a photograph by doubling a focus with the method of changing a 
focal position by a lookwithout moving a cameraand photoing the picture of two 
sheetsand a certain point (usually principal part)it can obtain by various kinds of 
meanssuch as a method of using the camera photoed [ against the background of 
a focal position ] automatically when a predetermined time camera does not move. 
[0021]The primary detecting element 18 which received the image data of two 
kinds of such pictures takes out several ingredients medium frequency to the edge 
componentfor examplethe high frequency componentor pan of both imagesand 
takes out the absolute value. Absolute value of the high frequency component 
(inside) of the picture whose focus suits to the principal part hereafter |Y Ca)The 

absolute value of the high frequency component (inside) of the picture whose focus suits to | Qp^J g background is 

made into |Y (b) MH |. What is necessary is just to take it out by the method that the 
method of subtracting low frequency components from the HARASHIN itemetc. 
are publicly knownafter a high frequency component (inside) generates low 
frequency components by the method and low pass filter which use a high (band) 
path filter. 

[0022]The image concentration (image data) and its junior-and-senior-high- 
schools frequency component of the one same pixel line in the picture of two 
sheets whose focus suits to the principal part and a background by the picture are 
typically shown in drawing 2 , The concentration of the picture to which the 
example shown in drawing 2 is an example of the picture which has the principal 
part in a center sectionand the focus of drawing 2 (a-1) suits to the principal 
partand drawing 2 (a~2) are the absolute values of the junior-and-senior-high- 
schools frequency component. |Y <a)Itis MH |As for drawing 2 (b~1)the concentration 
of the picture whose focus suits to the backgroundand drawing 2 (b-2) are the 
absolute values of the junior-and-senior-high-schools frequency component. |Y Cb) 

It is I 

mhI- 

[0023]Subsequentlythe primary detecting element 18 is shown belowfor example. 
|Y Ca) MH l The difference of |Y (b) MH | is taken. 

Y ~ sub - = - | - Y ~ - <—>-- M H I ~ I Y - - <->->- - MH - | - 
drawing 3 — ( — a — ) — drawing 2 — it can set — " — Y — sub - I Y 
- (~ a -) - — ^ — | _ | — y — --(-□--)-- — ^ — | — " — being shown . Image 

data (pixel) corresponding by that positive/negative can distinguish the principal 
part or a background by taking this difference so that more clearly than a figure. 
That isthe boundary (what is called an edge part) of the principal part of a picture 
and a background can be clarified. 

[0024]In this inventionthe way the principal part and the background of a 
pictureand its edge part are detectable using the picture of two sheets from which 
focal conditions differ besides the method of using such (inside) a high frequency 
component is available in some numbers. 

[0025]The discriminated result by the primary detecting element 18 is sent to the 
image processing portion 20. The image processing portion 20 to the image data of 
the picture whose focus suits to the principal part sent previously. If the image 
data (pixel) which the primary detecting element 18 distinguished by Y sub is the 



principal part according to the principal part or a backgroundsharpness (sharp- 
izing) processing will be hungif it is a backgroundBOKASHI processing will be 
hungand it is considered as the picture (image data) to which the back Japanese 
quince treatment effect was given. It is good also as a picture to which the back 
Japanese quince treatment effect was given using the picture whose focus suits 
to the background according to the target picture. Since it is the principal part in 
this example if it is Y sub >0 as shown in drawing 3 a sharpness process is hungand if 
it is Y sub <Osince it is a backgroundBOKASHI processing will be hung. The picture 
(image data) of said drawing 2 (a~1) after being able to hang a sharpness process 
or BOKASHI processing on drawing 3 (b) according to said distinction is shown. 
[0026]Thereforeaccording to the image processing device of this inventionthe 
work of a clipping of the principal part by the operator using an image-processing 
tool etc. is done unnecessaryAutomatically from the provided image datathe 
principal part is sharpthe picture to which the back Japanese quince treatment 
effect in which the background is fading was given can be formedand it is possible 
to create the print in which the high-definition picture which has a cubic effect 
and a feeling of depth was recorded by simple operation. 

[0027]Although the above example is an example using the picture whose focus 
suits to the principal partand the picture whose focus suits to the 
backgroundAlthough accuracy will fall if the focus of the principal part is removed 
even if the focus does not suit a background with high precision about the picture 
whose focus suits to the backgroundextraction of the principal part of a picture 
and the boundary of a background is possible. Since the difference of optical image 
magnification arises in the picture of two sheets by the difference among focal 
conditions in the image processing device of this inventionpreferablyit is 
methodssuch as acquiring the information on focal conditions from a cameraand it 
is preferred to carry out the knowledge of the focal conditions and to perform 
geometric coincidence of the picture of two sheets. In this casewhat is necessary 
is just to extract the boundary of the principal part of said pictureand a 
backgroundafter doubling with the picture which performed geometric amendment 
to the picture whose focus suited to the backgroundfor example and whose focus 
suited to the principal part. After obtaining Y sub as mentioned above in this 
inventionAfter performing the connecting process of the field of Y sub >Oand the 
connecting process of the field of Y sub <Orespectively and dividing the field of a 
picture into two clearlyby hanging a sharpness process and BOKASHI processing 
to eachA desirable result is obtained in respect of the ability to give a Japanese 
quince treatment effect more suitably. 

[0028]There is no limitation in particular in the method of a sharpness processand 
a publicly known method is available in some numbers. . For exampleare indicated 
by the method and JP63-26783A which use USM (unsharpness mask). Spatial 
information is computed by extracting a luminance signal and a color signal from 
image dataand performing a spatial filter process to a luminance signalHow to 
perform predetermined emphasis processing to this spatial informationsearch for a 
new luminance signalcompound this luminance signal and color signaland make it 



into the image data after processingDecompose into low frequency 
componentsseveral ingredients medium frequencyand a high frequency component 
the image data explained in full detail by the Japanese-Patent-Application-No. No. 
337510 [ seven to ] specification by these peopleand a brightness component is 
extracted from several ingredients medium frequency and a high frequency 
componentAfter performing processing which controls the extracted several 
ingredients medium frequency and emphasizes a high frequency componentthe 
obtained several ingredients medium frequencya high frequency componentand low 
frequency components are compoundedand the method of making it into the image 
data after processingetc. are illustrated. 

[0029]There is no limitation in particular also in the method of BOKASHI 
processingand using a low pass filter On the other handthe Boca ******Publicly 
known methodssuch as a method of giving characteristic BOKASHI by the shading 
off (movement) in the filter of photoshop of the methodfor exampleAdobeof using 
image-processing toolssuch as a method by equalization and retouching 
softwareshading off (radial)etc.are available in some numbers. 

[0030]In the processing unit 12 of this inventiongrant of the back Japanese quince 
effect by such image processinglt may carry outafter performing image processing 
the above-mentioned a color/the density correction[ compression/elongating ] of 
a dynamic rangeetc.or it may be chosen whether after giving the back Japanese 
quince effectsaid required image processing may be performedor according to the 
kind of image processingit processes before grant of the back Japanese quince 
effector it processes behind. 

[0031] As mentioned abovethe image data to which predetermined image 
processing was performed with the processing unit 14 (image processing portion 
20) is outputted to the printer 16 as image data for record. It is what is outputted 
as a print which the printer 16 exposed photosensitive materials by the recording 
light modulated according to image dataand performed the predetermined 
developmentand in which the picture was formed (reappearance)For exampleif it is 
a device using optical beam scanning exposureaccording to the image data sent 
from the processing unit 14will modulate an optical beamwill deviate to a scanning 
directionand. By conveying photosensitive materials (photographic paper) to the 
vertical scanning direction which intersects perpendicularly with a scanning 
directionby an optical beamscanning exposure (printed) of the photosensitive 
materials is carried out in two dimensionsa latent image is formedthe development 
according to photosensitive materialsetc. are performedand it outputs as a print. 
Besides printer 16the image data processed with the processing unit 14 of this 
invention is outputted to storages (the drive)such as a floppy disk and MOand it 
may memorize to a storage. 

[0032]As mentioned abovealthough the image processing device of this invention 
was explained in detailin the range which limitation is not carried out to the above- 
mentioned exampleand does not deviate from the gist of this inventionthis 
invention of various kinds of improvement and change being made is natural. 
[0033] 



[Effect of the Invention]As mentioned abovein the digital photo printer etc. which 
according to the image processing device of this invention read a film in 
photoelectricity and perform digital exposuresuch as an optical beam scanas 
explained in detaillt is possible to output easily the high print of added value which 
an operator does not need to do work time-consuming [such as a clipping of the 
principal part from a picture]can form the picture which gave the back Japanese 
quince effect automaticallyand is between solids and between depth and in which 
the high-definition picture was formed. 
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[Brief Description of the Drawings] 

[Drawing 1] It is a block diagram of an example using the image processing device 
of this invention of a digital photo printer. 

[Drawing 2] (a-1)(a-2)(b-1)and (b-2) are the graphs for explaining processing of the 

image data in the image processing device of this inventionrespectively. 

[Drawing 3] (a) And (b) is a graph for explaining processing of the image data in the 

image processing device of this inventionrespectively. 

[Description of Notations] 

10 (Digital) Photograph printer 

12 Scanner 

14 Processing unit 

16 Printer 

18 Primary detecting element 
20 Image processing portion 



